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Abstract / 

/ 

Multiple effects of an increased ra1:e pt teacher questions on the verbal 
behavior of three severely retarded children was investigated within a 
multiple baseline design. Teachpr/questions and subject answers increased 
significantly during the interverTtlon . Several unintended effects, in the 
form of behavior covariations. Were observed in. each subject's behavioral 
repertoire. Teacher comment^ on the effects of intervention wepe over- 
whelningly positive. The behavior covariations are discussed in terms of 
their desirability, causality, generality, predictability, strength, durabil 
ity, and magnitude, \r. 

/ 
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My perspective on "side effects" will be conie evident during the course 
of this presentation. Bob Wahler's experimental work (e.g., 1975) and an 
intriguing paper written by Jackie Molman entitled "The nwral risk and high 
cost of an ecoJi)^)ical concern in applied behavior analysis" (1977) initiated 
nir-interest in this area. The work o> Wahler and Patterson ( 1974) has been 
the focus of my interest. . Both of these researchers have studied the issue 
of side effects as it relates to social behavior. One obvious problem t>h&y 
have -encountered is the fact that it is quite hard to code soci<jl behavior, 
• partkularly non-vocal social behavior, into discrete categq^ries It. beeves 
a very difficult observational problem. In the study I'm going to ta>/ about, 
we have attempted to circumvent this problem somewhat by examiningXocal - 
verbal behavior. We did this for two .important reasons.' First/ ^^ocal behav- 
ior is very discrete relative to other behaviors, and thus t?^dily available, 
for a response analysis. Second, the contingent relatio;»^ips in verbal 
interactions are generally easier to discern than ammr^ other types of 
behaviors. Fgr these two" reasons, we hoped to do /study of the multiple 
effects of an intervejition which mightUhow rela^'vely clean effects. It 
has seemed quite cpnc^ivable to me that behav;i^r covariations ^nigbt be nS)^ 
successfully examined along the dimension o/ verbal behavior, with the current 
study as something o^ a prototype for sucm a line o'f research. 

The intent of the current study thfen, was to measure the mul tiplj^ effects - 
of a treatment intat-vention on the verbal repertoire of three i n'sti tution- 
alized. retarded. children. Normal]/ a behavior analyst might institute 
^evera-l modtfications generally identified as components of an incidental ' 
teaching procedure (Hart & Risl^y, 1975; Rogers-Warreh & Warren, in press) - 
when the therapeutic goal Is /o. Increase a child's v^rl?al repertoire. However, 
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for purposes of experimental rigor, only a single potent1c>lly powerful teache 
behavior, question-asking, was increased in a rtujltiple baseline across the 
three sul^jects. The Verbal behavior of the subjects was coded into 17 

I 

response categories and teacher verbal consequences were coded into 13 
response categories,' to allow an analysis of multiple responsls effects of 
the intervention. 

The purpose of this analysis was two fold: (1) to further contribute 
to the research on behavior covariations and side effects in "general, and ^ 
(2) to provide an analysis of the multiple (positive and negative) effects 
^which might be expected to result from this specific type of therapeutic 
intervention. Such iliformation will help verify tts usefulness and validity 
in similar clini-cal situations. 
Methods 

The three subjects in the study were severely retarded and resided at 
a state institution- and attended classrooms for language delayed students in 
that facility. They were observed in their respective classrooms. During 
these tines each subject wa§ seated at a table with the t-eacher and usually 
three or four other students. Subjects 1 and 2 were in one classroom with 
Teacher A; Subject 3 was in a second classroom with Tether B. During 
observation times Subjects! and 2 were Involved in such activities as 
counting, identifying colors; and identifying common signs; Subject 3 was 
involvgd in puzzle assembly, picture matching, etc. The instructional 
programs required the teachers to present trials to the students and/or give 

A 

feedback for perfomiance. The verbal interaction between teacher and student 
during these times was otherwjse unstructured. 



, The observation system we used was, designed to measure child verbal 
behaviors and adult verbal consequences for these behaviors. Child verbal- 
izations were coded as one of 17 possible behaviors which could be grouped ' 
into seven categories of verbal behavior: imitations, answers, mands, 
instructions, statements, inaccurate statements, and greetings. 

Because any given child verbalization could be defined by more than' 
one definition, the coding of definitions was done on the basi s, of , context, 
that^ is it's antecedents, consequences, and the topogVaphy surrounding i^. 

Mands, instructions, statements, inaccurate statements, and greetings 
were broken down into subject initiated and non-initiated sub-categories. 
This distinction was made because of the.. perceived likelihood that subject 
responses to teacher verbal consequences might change in ways independent 
of the subject's initiated speech. 

A teacher consequence was defiped as the, occurr^ence of any coded verbal " 
behavior that occurred within 5 seg after any subject verbal . behavior . Many 
of the behaviors that met. this requirement were also antecedents for sub- 
sequent subject responses. Thus, events were categorized according- to 
their apparent relationship; to subject verbal behavior. For example, conse- 
quences such as specific positives, general positives, specific negatives, 
and general negatives were all considered direct forms "oWeedback because ^ 
they appear to function primarily as .qonsequence^ for befhavlor rather than 
antecedents (promots) for the next subject response. Other consequences 
^.uch as questions and prompts, appear to function primarily ffs antecedents 
(pronipts) for additional subject verbal behavior* rather than as consequences, 
while some can serve a variety of functions. All subject response definitions 
and teacher consequence deflnftlons were mutually exclusive; ^ 
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Several 15-min observations were taRen for each child each week. The 
observer made a verbatim recording of everything said by and to the subject. 
After each session he then constructed a transcript of all the subject's 
verbalizations^and any verbal consequences for them using bothr^the verbatim 
.data and a tape recording. When the transcript was cOmp?ete, the observer 
then scored each verbal subject response and teacher consequence^ according 
to the behavior codes. - . 

. In the intervention condition, each- subject's classroom teacher was 
asked to increase their rates of asking questions of the subject. Question^ 
were defined,for purposes of the Intervention as- "an inquiry made to the 
subject requiring a verbal response other than 'yes' or ''no'". Thus, ques- 
tions meeting this definition required substantive verbal responses from 
the subjects, and were not theoretical in nature. The teachers were Instructed 
to increase their rates of question asking in conjunction with the primary 
task at hand and In a manner relevant to thi^ task. The entire Interven- 
tion procedure consisted only of requesting the teachers to increase their 

rates of other than yes/no questions.. 

» • . 
Results / ^ 

Figure 1 shows the number of questions directed by the teachers to each 

subject &s well as the number of answers for each subject per block of 

responses.. - ' ' 

Insert Figure 1 about here ^ 

■ In' order to address^he questlon^f "multiple effects" of this Inter-- 

vent'loh 1n the form of behavior covariations, a Pearson Product-Mbmept 

• ' ■ ' , . J *- 

corre"l#t1onal analysis was conducted for teacher "consequences and subject 

responses. For teacher consequences, the score of each type of consequence 
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was correlated with the score for-teacher questions by blocks of resp6nses. 
For subject responses, the score for each type of response per block of ' 
data was correlated with subject answers per block of data. Table 1 shows 
those teacher consequences covarylng both positively and negatively with 
teacher questions and those subject responses covarying negatively (none 
covaried positively) \ith answers. The correlations shown were signrficant 



Insert Table 1 about here ^ 



at the .01 level of confidence. All occurred during the intervention 
condition. ' 



^ • Only one^positive correlation was found, between teacher questions and 
general ^sitives directed to Subject 2. i^he only teacher consequence that 
covarietmgatively with teacher questions for more than orlfe subject was 
mands from Teacher A to Subjects 1 and 2. Among those subject responses 
covarying with^subject answers, were question/mands for Subjects 1 and 2," 
the statements for all three subjects. No answers also correlated negatively 
for Subject 3. ' 

. . To coijiplete the analysis of multiple effects of the interyentibn, the 
two teachers participating in the study were surveyed as to the pc/sitive 
and negative effects they observed as a result of the interventljc/n. 
■ • Several po.siti ve effects were noted by the teachers. Bothyindicated 
. that as the intervention continued they felt 'the quality of thiir question ■ 
askirrg improved and* that their students gave more varied answers. Both 
indicated that their subjects began to ini ttaj^e 'more speech in general as - 
the intervention continued and to answer questions wUh less prompting.* 
Teacher B also noted that other students iiigan to ask their peers ^p<Rt ions 
and to shape answers, a possible effect of teacher modeling, and ttiat her - 
own rate of questions to other students increased. 
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No major negative effects were reported by the teachers for either 
themselves or their students. However, they reported that tKe procedure' 
was sometimes more difficult to use than other times , depending on the- 
academic program being run concurrently and that the, academic programs often 
took slightly longer to run as a* result of using the procedure. 

Discussion 

the intended intervention effect^ In this study were stable and strong 
for both question-asking and subjects' answers. The correlations reported 
reveal multiple effects which appeared to result from the intervention. 
Obviously, other types of multiple effects may -have occurred as a result 
of the intervention. These could have shown up either qualitatively in 
other settings, at ather times,, or they could have been non-vocal in nature. 
However,^ such changes were either not strong enough to be noticed by the 
teachers, or were too low rate to be reliably observed during the observa- ^ 
tion sessions. The correlated changes that did^occur will be discussed in 
terms, .of desirability, causality, generality,- predictability, strength, 
durability, and magnitude. 

Desj^ rability . Five teacher consequences covaried with teacher questions 
General positives increased and general negatives decreased for Teacher A. 
to Subject Both of these changes are obviously desirable effects. 
Negative correlations for. yes/no questions, mands and instructions for 
Teacher A to 'Subject 1, and mands for Teacher A with Subject 2 appeared to 
b.e neither particularly desirable or undesirable effects. Two responses 
covaried with answers for the three subjects. Statements covaried negatively 

. :. - , ■ ■ \ ' 

for all three, and qu6stions/mands covaried for Subjects 1 and 2. These. 

w 

change's might be considered potentially undesirable. Mands are verbal 



responses which function tp control t^e. ^eakers' environment and' in this 
'sense can be considered a valuable asset. While statements do "not. necessar- 
ily produce functional consequences, they were ty definition correct' and 
appropriate verbal responses. Since any correct and appropriate verbal 
behavior is desipbTe with severely retarded institutionalized children, ' 
the negative correlations noted here might be considered potentially undesir 
able. However, neither mands nor statements dropped out of the" subj-ects' 

i repertoires by any means. The correlated decrease in the no answers cate- 
gory for Subject 3 might be considered a positive effect since th'is suggests 
a greater degree of responsiveness was attained for this. subject as a result 
of the intervention. 

Causarijy_. 'it is possible only to speculate about what specifically 
caeised these behavior correlations 'because the analysis does not indicate 
whether the behavi-ors were related on a moment-by-hioment basis within a 
session. Thus, , one might S|5tculate that teacher yes/no questions, mands 

. and instructions directed to Subject 1 covaried negatively with Tea.cher A*s 
questions because the function of these responses was supplanted by the 
increased questions. The positive correlations in teoctier general-positives 
to Subject 2 and the negative correlation in general negatives may have 
resulted from an increased sensitivity on the part of Teacher A to the 
performance of Subject 2, or to the .topography of her own behavior as a 
-teacher. The negative correlations in subject question//mands and statements 

• may have resulted from inci;'eased teacher control of the verb.ai interchange 
resulting from their high rate of question asking. That is,, the subjects 
simply had insufficient time or perhaps reason to engage in these behaviors 
proportlonany as much. " ' " 

r . ■ • • 
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Generality. There is a striking lack of generality across subjects for 
those teacher consequences V:ovarying \^ith questions. 

.Predictabi lity. The lack of generality in covariations across teacher 
and S4bjecl repertoires reflects the difficulty a therapists might h^ve had 
in predicting the response classes actually found on an apriori basis. 
Some logical predictions were possible and might have been borne out by the 
data. However/ the lack of* generality' in the results would obviously have 
voided many, of these. Furthermore, ^mahy responses might-have-been predicted 
to covary that didn't. ^ ' ' • 

Strength and durability. The fact that the, covariations were found at 
the .01 level of confidence indicates they mAy have been strongly related to 
teacher questions or subject ,ariswers^ However, the durability of these 
\co>^iation.s is uncertain. None of them were found to covary with, questions 
or answers during the baseline. Thus, they could have been an artifact of 
the intervention, such that the relationships might have- washed .out' had 
another experimental condition been implemented. 

flagni tude . The issue of magnitude is important to a balanced perspec- 
tive on the covariations fpund.- Despite their-strong statistical signif- 
icance, these covariations were simply not' very moticeable to the naked eye.' 
While the teachers were readily aware of the increases ir\,theij own question 
asking behavior and their student;s' answers, they did not repqrt any of . 
the effects noted as statistical covariations here. In their op1nfibr)s., 
the intervention was a complete success with 'very few notable drawbacks'. 

Willems (1977) has largued On the basisv of the e^cological literature 

■ ■ , ■ " , , ' ' ' 

reported from, the'tiatural sciences that "ever^ intervention ha? its price, 
•no matter how w^Jl intentloned." Thi> study supports a second argument,. 



•however. It is undeniably true that unintended and unexpected effects mVy 
occur when an individual's behavior is mod^lfied, but the results jof this' 
study and other^s sugg'est that the desirability, causality; strength, dura- 
bility, generality, and predictability of these effects are- of a capricious 

nature. , . , , 

<• , . • ' 

By purposefully modifying a single verbal behavior, a systematic analy 
of resulting multiple effects was attempted. In actuality, there were many 
types of possible effects which were not systenlati cal ly measured for./ Such 
a comprehensive analysis was not possible because of the enormous amount of 
time and- labor it would have necessitated. Ultimately, it was necessary to 
rely on reports Of teaf.hers to complete the analysis. Paradoxically, the' 
magnitude of ;tl?e muiripl.e effects that were found suggest that this simple 
survey jnethod probably would have been sufficieht to identify any serious 
effects. • ^ , 



!■ 



References ' i . . j 

. . j ■ . - I . 

Hart, B., * Risley, T; p. Indicental teaching of language in the preschool - 
Journal, of Applied frehav_1oj^Ana^^ 1975; 8, 411-420. 

Holman, J. The moral risk and high cost of ecological concern in applied 
behavior analysis. In A. Rogers-Warren & S. F. WaVurfn (Eds.), Ecological 
perspectives In behavior analysis . Bait litiorg: University Park Press, 1977 

Patterson, G. R. A be(sis for identifying stimuli, which control behaviors 
in 'natjural settings. Child .Development , 1974, 45^,' 900-911. 

Rogers -Warren, A., & Warren, S. F. Mahds for verbalization: Facilitating 
the display of newly-trained language. Behavior Modification , In press.- 

Wahler, R. 6. Some structural aspects of deviant chi^ld behavior. Journal 
of Applied Behavior Analysis, 1975, 8, 27-42. 

Willems, E. P. Steps toward an ecobehavioral technology. In A. Rogers- 
Warren & S. F. Warren (Eds.), Ecological perspectives In behavior analysis . 
Baltimore: University P^frk Press, 1977. 



CC 
UJ 

a, 

CO 

cr 

UJ 

z 

< 



(J 

UJ 

m 
in 

Q 
z 
< 

CO 

z 
g 

D 
O 

oc 

UJ 

UJ 
H 

u. 

O 



> • 

ERIC 



cr 

^.4 



45 
30 
15 
0 
.45 
30 
15 

o' 

45 

30 
15 
0 



^ BASELINE 



, INTERVENTION 



SUBJECT '1 




SUBJECT *2 



SUBJECT '3 



TEACHER QUESTIONS 
MEAN PER CONDITION 

SUBJECT 'ANSWERS, 
MEAN PER CONDITION 




BLOCKS OF RESPONSES 



^5 



Tabic 1 

Correlations Significant at the ,01 Level 
The correlation coefficient is shown in parentheses 



to 
C 

<u o 



to a> 
o 

8 



Subject 1 
[Teacher A) 



0) o 

> -r- 

a> ^ 
2^ J- 
o 



Consequences Correlated with Teacher Questions: 



Subject 2 
(Teacher A) 



General 

Positives (.66) 



Subject 3' 
(Teacher B) 



Yes/No Questions 
(.64) 

Ma^ds ■ (.60), 

Instructions ( .56) 



General 

Negatives (.75.) 



Mands 




to 
c 

01 O 

o u 

o 
o 



4/) 

c 
<u o 
> 

•r- 4^ 
4-> ITS 
<0 I— 
(U 

o 

o 



Responses Correlated with Subject Answer Combinations: 
Subiecti ■ ' Subject 2 , Subject 3 



Question/Mand (.67) 
Statements (.56) 



Question/Mand (.51) 
Statements ( . 75) 



No Answers (.73) 
Statements (.52) 



